Modality Fusion in a Route Navigation System

In this paper we present the MUMS Multimodal Route Navigation System which combines speech, pen, and graphics into a PDA-based multimodal system. We focus especially on the three-level modality fusion component which we believe provides an accurate and more flexible input fusion than the usual twolevel approaches. The modular architecture of the system supports flexible component management, and the interface is designed to enable natural interaction with the user, with an emphasis on adaptation and users with special needs.